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Let  F(s,t)  *  P(X  >  s,  Y  >  t)  be  the  bivariate  survival  function  which  is 
subject  to  random  censoring.  Let  F(s,t)  be  the  bivariate  product  limit 
estimator  (PL-  estimator)  by  Campbell  and  Foldes  (1982,  Proceedings  of  the 
International  Colloquium  on  Non-parametric  Statistical  Inference,  Budapest  1980, 
North  Holland).  In  this  paper,  it  was  shown  that 
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mean 


Fn(s,t)  -  F(s, t )  *  n  E  Ci(s,t)  +  Rn(s,t),  where  {(^(s.t)}  is  i.i.d 

1=1  "  -1  3/4 

zero  process  and  R  (s,t)  is  of  the  order  0((n  log  n)  )  a.s.  uniformly  on 

-1/2  n 

compact  sets.  Tightness  of  the  process  {n  E  £  (s,t))  is  shown  which 

i-1  1 


implies  the  weak  convergence  of  the  process  to  a  two-dimensional-time  Gaussian 
Process  whose  covariance  structure  is  given.  Corresponding  results  are  also  derived 
for  the  bootstrap  estimators.  The  results  can  be  extended  to  the  multivariate 
cases  and  are  extensions  of  the  univariate  case  of  Lo  &  Singh  (1985, 


Tech.  Report,  Dept,  of  Statistics,  Rutgers  University).  Since  Fn(s,t)  may  not  be 


a  survival  function,  it  is  modified  to  be  one.  The  modified  estimator  is 
closer  to  the  true  survival  function  than  the  bivariate  PL-estimator  in 


supnorm. 
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1 .  Introduction  and  Summary. 

The  one-dimensional  product  limit  estimator  (PL-estimator)  by  Kaplan  & 

Meier  (1958)  has  been  treated  extensively;  e.g.  Breslow  &  Crowley  (1974). 

Csorgo  &  Horvath  (1983),  Gill  (1983)  and  etc.  Recently  Lo  &  Singh  (1985); 

hereafter  abbreviated  as  [L&S]  (1985);  represent  the  PL-process  as  mean  of 

-1  3/4 

i.i.d.  processes  with  a  remainder  of  the  order  0((n  log  n)  )(a.s.)  uniformly 
on  a  compact  interval.  The  functional  law  of  iterated  logarithm  (LIL)  and  the 
weak  convergence  of  the  PL-estimator  by  Breslow  &  Crowley  (1974)  are  all 
direct  applications  of  this  i.i.d.  representation. 

The  bivariate  (or  more  generally,  the  multivariate)  random  censoring 
model  did  not  appear  in  the  literature  until  near  1980. 

Let  (X^,Y^),  i  *  l,...,n  be  the  lifetime  vectors  of  n  pairs  of  items 
which  are  i.i.d.  with  continuous  survival  function  F(s,t)  =  P(X®>  s,  >  t). 

Let  (Cj ,  Dj)  be  the  vector  of  censoring  times  of  (X^,  Y^)  and  (C^.D^)  i  *  1,..., 
are  i.i.d.  with  survival  function  G(s,t)  *  P(C  >  s,  D  >  t).  In  the  bivariate 
random  censorship  model,  one  observed  (X^,  Y^,  6^^ ,  62^),  *  *  !»*••»&*  where 

X  -  min{X°,  C  },  Y  -  min{Y°,  D  }, 

6^*  1  or  0  according  as  X®  <  C^  or  X^  >  C^ ,  and 
1  or  0  according  as  Y^  <■  or  Y®  >  . 

It  is  assumed  that  (X®,  Y®)  and  (C^,  D^)  are  mutually  independent,  for  i  *  1,... 
Let  H(s,t)  ■  P(X^>  s,  Yj>  t)  denote  the  survival  function  of  (X^,  Y^).  By 
independence,  H(s,t)  ■  F(s,t)  G(s,t).  Based  on  the  observations  (X^ »^2i^ 
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one  would  like  to  estimate  F(s,t). 

Situations  where  estimators  of  the  bivariate  survival  functions  are  needed  in 
the  presence  of  random  censorship  arise  commonly  in  medical  follow  up  for  paired 
observations  (eyes,  kidneys,  matched  pair  of  treatment  and  control  objects,  and 
(pre-test,  post-test)  situations),  and  in  engineering  for  two-component  system 
of  which  the  two  components  are  dependent  on  each  other.  Another 
potential  application  is  the  stochastic  regression  model  where  both  the 
independent  and  dependent  variables  are  subject  to  random  censoring.  Campbell 
(1981)  developed  a  bivariate  self-consistent  estimator  for  discrete  times  of 
deaths  or  losses.  A  self-consistent  approach  for  the  continuous  case  has 
been  suggested  by  Korwar  &  Dahiya  (1982).  Under  the  condition  D^, 

Munoz  (1980a,  1980b)  shows  how  to  compute  the  two-dimensional  generalization 
of  the  PL-estimator  through  algorithms  and  proves  it  is  the  generalized 
maximum  likelihood  estimator  and  its  consistency.  Hanley  and  Parnes  (1983) 
use  the  EM  algorithm  to  treat  maximum  likelihood  approaches  to  bivariate 
estimations.  Tsai,  Leurgans  and  Crowley  (1983)  also  construct  a  family  of 
nonparametric  bivariate  estimators  from  a  decomposition  of  the  bivariate 
survival  function  and  shows  their  consistency.  Campbell  &  Foldes  (1982);  here¬ 
after  abbreviate  as  [C&F]  (1982);  construct  two  path  dependent  bivariate 
PL-type  estimators  of  the  true  survival  function  F(s,t)  and  establish  their 
rates  of  strong  uniform  consistency  on  a  compact  set.  Noted  that  the  estimators 
may  not  be  survival  functions  (see  section  6  of  [C&F]  (1982)).  Later  on 
Campbell  (1982)  shows  the  weak  convergence  of  these  bivariate  PL-estimators  to  a 


Gaussian  process.  Horvath  (1983)  generalizes  the  results  of  [C&F]  (1982)  to  the 
multivariate  case  and  obtains  the  rate  of  convergence  on  the  Euclidean  space 

It  is  the  purpose  of  this  paper  to  further  investigate  the  path  dependent 
bivariate  (multivariate)  PL-estimator  of  [C&F](1982)  (Horvath  (1983)).  For  simplicity, 
we  shall  focus  on  the  bivariae  case.  The  multivariate  case  can  be  dealt  with  similarly. 
Two  path-dependent  PL-estimators  are  introduced  in  Section  2  of  [C&F](1982).  We 
shall  consider  only  one  of  them  in  this  paper  as  the  other  can  be  treated  with  symmetric 
argument. ^We  shall  estimate  F(s,t)  based  on  the  fact  that  F(s,t)  =  F(s,0)F(t | s) , 
where  F(t|s)  =  P(Y^>  t|X^>  s) . 

n 

Let  N  (s,t)  -  N(s,t)  =  l  I(X.>  s,  Y.>  t) 

i*l 

a.(s,t)  -  I(X.<  s,  Y, >  t,  1),  i  *  1,2, ...,n, 


0 j(s,t)  ■  I(Xj>  s,  Yj<  t,  &2 j*  1)»  j  *  1 »2 . . 

where  I(*)  is  the  indicator  function.  To  estimate  F(s,o),  project  all  points  (X^.Y^) 
vertically  onto  the  X-axis  and  ignore  the  Y^  values.  Let  Fn(s,0)  be  the  one¬ 
dimensional  PL-estimator  of  F(s,0)  based  on  (X  i  ’  6li)*  1  *  !»•••, n-  That  is  , 


Fn(s,°) 


where  X,  max  { X . ) . 

(n)  »i<n  1 


n  N(X  0)  o  (s,0) 

1*1(  N(Xi,0)+l  }  if  S  *  X(n) 


otherwise, 


To  estimate  F(t]s),  project  all  points  (X^  ,  Y^)  for  which  X^>  s  horizontally  to  the 
line  X  •  s,  and  ignore  the  X^  values.  Let  Fn(t|s)  be  the  one-dimensional  PL-estimator 
of  F(tjs)  based  on  (Y^,  ^i^*  for  whlch  X^  >  s.  That  is, 


Fn(t|s> 


n  ^  NCa.Yj) 

ill  N<s*  Yj>+1 


8,(8, t) 


otherwise, 


if  t  <  V(n)(s) 


where  Y.  .(s)  ■  max  {Y. :  X.>  s} 
(n)  l<i<n  1  1 


Our  estimator  of  F(s,t)  is  Fn(s,t)  *  F  (s,0)Fn(t| s) ,  which  is  the  product 

A 

of  two  one-dimensional  PL-estimator.  Note  that  F^Cs.t)  may  not  be  a  survival 
function  as  mentioned  earlier. 

Let  (S,T)  be  any  fixed  point  in  li?  such  that  H(S,T)  >0.  In  this  paper,  we 

1/2  A 

shall  consider  the  behavior  of  the  bivariate  PL-process  n  (Fn(s,t)  -  F(s,t))  on 
the  compact  rectangle  [0,S]  *  [0,T].  The  results  of  [L&S]  (1985)  are  extended  to 

A 

the  multivariate  case.  Since  the  i.i.d.  representation  of  F^fs.t)  -  F(s,t)  in 
section  3  originates  from  the  corresponding  univariate  case  in  [L&S]  (1985), 
the  relevant  results  are  summarized  in  Section  2. 

In  Theorem  3.1  the  bivariate  PL-process  Fn(s,t)  -  F(s,t)  is 

1  ^  —  1  3  /  ^ 

expressed  as  n  E  C  (s,t)  plus  a  remainder  of  the  order  0((n  log  n)  ) 

i-1 

(a.s.)  uniformly  on  [0,S]  *  [0,T] ,  where  C^(s,t)  are  i.i.d. 

random  variables.  The  mean  and  covariance  of  the  process  {c(s,t)}  are  given 


in  Proposition  3.1. 


_  - 1  n  1/ 2 _ 

Let  £(s,t)  *  n  E  C^(s,t).  Tightness  of  the  process  {n  ?(s,t)}  is 


shown  on  compact  sets  (Corollary  4.1),  and  therefore  implies  the  weak 

1/2  * 

convergence  of  the  bivariate  PL-process  n  (F  (s,t)  -  F(s,t))  to  a 

n 

two-dimensional-time  Gaussian  process.  Noted  that  although  the  weak 
convergence  of  the  bivariate  PL-process  has  been  shown  in  Campbell  (1982), 
the  covariance  structure  of  the  limiting  Gaussian  process  is  first  given  in 
this  paper  in  Proposition  3.1.  The  LIL  on  compact  sets  also  follows  directly 
which  generalizes  the  results  of  [C&F]  [1982].  The  proof  of  tightness  in  the 
bivariate  case  is  much  harder  than  the  univariate  case  in  [L&S]  (1985),  and 
utilizes  the  tightness  results  of  Bickel  &  Wichura  (1971).  In  Sections  3  and  4 
similar  results  are  also  obtained  for  the  bootstrap  bivariate  PL-process  (defined 
in  Section  3),  which  provide  a  way  to  estimate  the  standard  error  of  Fn(s,t) 
or  to  give  a  confidence  interval  (band)  for  F  (s,t). 

Since  the  bivariate  PL-estimator  Fn(s,t)  may  not  be  a  survival  function, 
a  modified  estimator  Fn(s,t)  which  is  a  survival  function  itself,  is  constructed 
in  Section  5.  The  modified  estimator  Fn(s,t)  is  shown  in  Theorem  5.1  to  be  closer 

to  the  true  life  distribution  than  F  (s,t). 

All  the  results  in  Sections  3  to  5  are  generalized  to  the  multivariate 
case  in  Section  6. 

Some  of  the  lengthly  proofs  are  relegated  in  the  appendices. 

While  this  paper  deals  only  with  the  multivariate  random  censoring  model, 
it  is  possible  to  extend  the  results  to  the  multivariate  competing  risk  models. 
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2.  Preliminaries 

Since  the  i.i.d.  representation  of  F^(s,t)  -  F(s,t)  in  section  3  originates 
from  the  corresponding  univariate  case  in  [L&S]  (1985),  for  readers’  convenience 
we  shall  summarize  the  relevent  results  of  the  univariate  case  in  this  section. 

Let  us  first  define  some  notations  for  the  univariate  case.  Let  (X^} , 
i  =  l,...,n  be  i.i.d.  with  continuous  survival  function  F(t)  =  P(X®>  t),  and 
{ } ,  i  *  l,...,n  be  i.i.d.  with  survival  function  G(t)  =  P(C^>  t),  where 

and  X^  are  independent  for  each  i.  In  the  univariate  random  censorship  model 
one  observes  (X^.6^),  where  X^»  min(X^,C^)  and  6^  *  1  or  0  according  as 

X°  <  C  or  X°  >  C^.  Let  H(t)  -  P(Xi>  t)  and  H^t)  =  P(X°  >  t  and  6^  1). 

For  any  positive  reals  x,t,  and  6  taking  values  0  or  1,  define 

<t>(x,6,t)  =  “  [g(xAt)  +  H(x)  1I(x  <  t  and  5  =  1)],  where  g(y)  =  [H(s)]  2d  H1(s) 

a 

and  x  t  means  the  minimum  of  x  and  t.  Let  F^(t)  be  the  PL-estimator  of  F(t), 

and  A  be  any  point  such  that  F(A)  >  0.  For  t  <  A,  it  can  be  checked  without 

difficulties  that  <Kx,6,t)  is  a  uniform  bounded  random  variable  with  mean  zero  and 
Cov(<(>(X,<5  ,s)  ,  4>  ( X ,  6  ,t))  =  -g(sAt). 

Next,  we  shall  define  the  bootstrap  sample  of  the  PL-estimator  F^(t).  As 
mentioned  in  Efron  (1981)  we  shall  adopt  the  method  of  drawing  random  samples 
(with  replacement)  (X^ ,  <5  ^ ) ,  i  *  l,...,n,  from  the  population  {(X^,  6  ^ ,  i  =  l,...,n} 
giving  each  doublet  equal  chance  (1/n)  at  each  draw  and  constructing  the  PL- 

*  A  *  ★ 

estimator  (t)  using  the  bootstrap  sample  (X^ ,  6^).  The  histogram  of  a  large 

1/2 

number  of  values  for  n  (F^-  F^)  is  used  to  approximate  the  distribution  of 
n  (F  -  F)*  Proposition  2.1  provides  a  first  order  consistent  approximation  and 
hence  shows  the  validity  of  the  bootstrap  method. 


Proposition  2.1.  If  F  Is  continuous,  one  has  the  following  i.i.d 
representations : 


(a)  log  F  (t)  -  log  F(t)  *  n  1  I  <KX  ,6  t)  +  Y  (t),  where 
n  i-i 

Sup  | Y  ( t )  |  -  0((n  1log  n)3^)  a.s. 

0<t<A 


(b) 


F  (x)  -  F(x)  =  n_1F(t)  I  <f(X  ,6  t)  +  Y  (t) 
n  1«1  1  1  n 

where  Sup  |y  (t)|  =  0((n  ^log  n)3^)  a.s. 

CK  t<A 


(c)  F*(x)  -  F(x)  =  n_1F(  t)  I  [4>(X* .  6*,t)  -  4>(X±  ,6±  ,t )  ]  +  Y*(t) 

1  =  1  "  L 

i*i  -1  3/A  *  * 

where  Sup  |y  (t)|  *  0((n  log  n)  )  a.s.  (p  ),  and  p  stands  for 

CK  t<A  n 


P  in  bootstrap  probability. 


Proof:  (b)  and  (c)  are  Theorem  1  of  [L&S]  (1985),  and  (a)  follows  from  the 

proof  of  Theorem  1.  0 

The  i.i.d.  representations  in  Proposition  2.1  ((a)  and  (b))  provide  a  way 
to  study  the  large  sample  properties  of  F^ft)  and  its  hazard  function 

A 

-  log  F  (t).  As  a  result,  weak  convergence  and  law  of  iterated  logarithm 
(LIL)  follow  immediately.  Proposition  (2.1)(c)  shows  the  feasibility  of 
the  bootstrap  method  for  estimating  the  standard  error  of  the  PL-estimator 
F  and  constructing  confidence  band  for  F(t). 
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3 .  I.I.D.  Representations. 

In  this  section,  the  results  of  Proposition  2.1  are  first  extended  in  Lemma  3.1 
to  conditionnal  survival  functions  and  then  in  Theorem  3.1  to  bivariate  survival 
functions.  For  the  bivariate  case,  we  shall  consider  the  same  bootstrap  method  as 
in  Section  2  of  drawing  random  samples  (with  replacement) 

(Xi>  6^,  02i^»  *  *  from  the  population  ft  =  {(X^,  6^,  ^2i^; 

i  *  l,...,n),  giving  each  element  in  ft  equal  chance  (1/n)  at  each  draw.  The 

"  * 

bivariate  PL-estimator  F^Cs.t)  is  then  constructed  as  Fn(s,t)  but  using  the 

It  it  It  It  *  *  *  it  *  it 

bootstrap  sample  {(X^,  Y^,  6^,  ^2i^ i“l» *  * • *n  instead;  thus  Fn(s,t)  =  Fn(s,0)  F  (t|s) 

We  shall  adopt  the  notations  of  Section  1  for  the  bivariate  censor  model, 
and  define  H(t|s)  =  P(Y  >  1 1 X  >  s) ,  H1(t|s)  =»  P(Y  >  t,  62»  1 1  X  >  s), 

H^(s)  ■  P(X  >  s,  1).  For  positive  reals  x,y,s,t,  and  S^,62  taking  values 

0  or  1,  let 

5(x,6lfs)  =  -  [ g( x A s)  +  [H(x,0)J  1I(x<s  and  6^=  1) J ,  where  g(x)  =  /*[H(s,0) ]_2dHlx(s) 
and 

^y,l52,t^  =  -l8s(yAt)  +  [H(y  |  s)  ]  ^I(y*t,  62=  1)],  where  gg(u)  =  /q  [H(  y  |  s)  ]  2dH]L(y|s) 

Let  (S,T)  be  any  point  with  H(S,T)  >  0. 

n  *  n  * 

Let  m  -  E  I(X,>  s),  m  «  E  I(X,  >  s)  . 

S  i-1  1  S  i-1  1 

Lemma  3.1.  The  following  is  true  if  F(s,t)  is  continuous. 


(a)  log  Fn(t|s)  -  log  F(tjs)  -  mg  Z  fi^.OKX^  s) 

1  ^  /  /, 

+  R  (tjs),  where  Sup  jR  (tjs)[  *  0((n  log  n)  )  a.s. 

n  0<s<S ,  0<t<T  n 

(b)  log  F*( tjs)  -  log  Fn(t|s)  -  m*_1  I  ^[CS(Y*.  6*1,t)I(X*  >  s)  - 

5s(Yi’  52i*t)I<Xi>s)1  +  Rn(tls)‘  where 

Sup  |R  (tjs)]  *  0((n  ^log  n;  j  a.s.  (P  ),  where  P 

0<s<S ,  0<t<;T 

stands  for  the  bootstrap  probability. 

Proof:  The  proof  Is  similar  to  that  of  Theorem  1  of  [L&S](1985)  and  is  given  in 
Appendix  I .  Q 

Let  n(x,y,61,62,s,t)  »  ^(x.^.s)  +  [H(s,0)]  ^^SgCy ,  ,  t )  I(x  >  s).  Define  H  (t|s) 

*  *  *  *  *  * 

H^( tjs),  H^^Cs)  similarly  by  using  the  bootstrap  sample  (X  ,Y  ,6^,  52)  instead. 

Theorem  3.1  If  F(s,t)  and  G(s,0)  are  continuous,  we  have 

•*  -1  n 

(a)  log  Fn(s,t)  -  log  F(s,  t)  ■  n  l  n(X1  ,Y1 , 6]L1 , 62i  ,s ,  t)  +  Rn(s,t)  where 

Sup  jR  (s,t)j  -  0((n  *log  n)^*)  a.s. 

(Ks<S,  0<t<T  " 

-1  n 

(b)  Fn(s,t)  -  F(s,  t)  =  n  F(s,  t)  l  nCX^Y^  6^ ,  521>s,t)  +  R'(s,t)  where 

Sup  jR  (s,t)j  -  0((n-1log  n)^)  a.s. 

0<s<S,  0<t<T 


(c)  F  (s,t)  -  F  (s,t)  -  n_1F(s,t)  Z  [n(X*,  Y*.  i*  ,  6^,  s,t) 

i-1 


-  n(Xi,  Y1,  6li,  52i,  s i t ) ]  +  Rn(s,t)  where 


Sup  |R  (s,t) |  -  O((n-1log  n)3^4)  a.s.  (p*). 

0<s<S ,  0<t<T 


Proof  of  (a): 

Proposition  2.1(a)  and  Lemma  3.1  imply  that 
log  Fn(s,t)  -  log  F(s,t)  -  [log  Fn(s,0)  -  log  F(s,0) ]  +  [log  Fn(t|s)  -  log  F(t|s)] 

-1  n  -1  n 

*  n  Z  £(X^ ,  6u,s)  +  msi  Z  ^g(Yif  «2  .OKX^  s)  +  Rnl(s,t),  where 
i-1  i-1 

Sup  |R.  .(s.t)!  -  0((n_1log  n)3/4)  a.s. 

0<s<S,  0<t<T 


-  n  Z  nCXj,,  Y1,  6 1± ,  62i,s,t)  +  Rnl(s,t)  +  Rn2(s,t),  where 
i-1 

-1  -1  n 

Rn2(s,t)  -  (n/ms  -  [H(  s,0)  ]  }  n  Z  Ks(Y±t  Sn,t)I(Xi  >  s). 

It  is  easy  to  see  at  this  stage  that,  Rn2(s,t)  -  0(n  Hog  log  n)  a.s.  for  each  (s,t) 
To  show  that  it  holds  uniformly  for  0<s<S,  0<t<T,  we  shall  apply  the  functional 
LIL  due  to  Dudley  &  Philipp  (1983  Theorem  4.1). 

Let  Z^  -  5g(Y^,  62^,t)I(X^  >  s),  Z^  takes  values  in  D[0,S]  *  D[0,T]  under  the 


sup  norm  1  I  on  [0,S]  x  [0,T1,  and  S  -  Z  Z..  It  is  clear  that  EIZ,  I  <  <*>,  and 


hence  Condition  (4.2)  of  Dudley  &  Philipp  is  satisfied. 

1/2 

Condition  (4.1)  is  satisfied  due  to  the  tightness  of  the  process  n  which 

is  shown  in  Theorem  4.1  of  the  next  section.  It  then  follows  from  Theorem  4.1 
of  Dudley  &  Philipp  (1983)  that  ISn/nl  -  0((n_1log  log  n)1/2)  a.s. 

Also  Sup  |n/m  -  [H(s,0)]-*|  -  0  ((n  Hog  log  n)^2)  a.s.  from  the  LIL  for  empirical 
0<s<S  8 

distribution  and  the  fact  that  H(S,0)  >  0. 

We  have  thus  shown  that 

Sup  |R  _(s,t)j  »  0(n  Hog  log  n)  a.s.  . 

0<s<S,  0<t<T  n 

(a)  follows  with  R  (x,t)  ■  R  ,(s,t)  +  R  ,(s,t). 

n  ni  nz 

Proof  of  (b)  :  Let  Zf  Y^  6^,  6^,  s,t). 

It  can  be  checked  easily  that  Z ^  is  uniformly  bounded  on  {0,S]  x  [0,T].  Applying 

Theorem  4.1  of  Dudley  &  Philipp  (1983)  once  more,  we  have 

-1  n  -1  1/2 
Sup  | n  I  n(X  ,  Y  ,  6..,$,.,  s,t)]  -  0((n  log  log  n)  )  a.s. 

0<s<S,  0< t<T  i-1 

(b)  then  follows  from  (a)  and  the  two-term  Taylor’s  expansion  of 
Fn(s,t)  -  F(s, t)  -  exp [log  Fn(s,t)j  -  expflog  F(s,t)]. 

Proof  of  (c):  Using  Proposition  2.1(c)  and  Lemma  3.1(b)  the  proof  follows  by 
mimicing  the  proof  of  (a)  and  (b) .  Q 

The  following  LIL  follows  from  the  proof  of  Theorem  3.1  by  applying 
Theorem  4.1  of  Dudley  &  Philipp  (1983). 
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Corollary  3.1  If  H(s,t)  is  continuous,  we  have 

(a)  Sup  | F  (s,t)  -  F(s, t) !  -  0((n-1log  log  n)1/2)  a.s. 

0<s<S ,  0<t<T  n 


,  1/2 
(b)  Sup  |F  (s,t)  -  F  (s, t) j  -  0  ((n  log  log  n)  '  )  a.s. 

0<s<S,  0<t<T  n  p 

Noted  that  Corollary  3.1  (a)  was  also  obtained  in  [C&F]  (1982)  but  (b)  has 
never  been  shown  to  the  best  of  our  knowledge. 

Let  n(s,t)  -  n(X,Y,  6^ ,  S2»s>t)  and  r((s,t),  (s',t'))  -  Cov(n(s,t),  n(s',t')). 
The  mean  and  covariance  structure  of  the  process  tn(s,t)}  is  given  in  the  next 
proposition. 

Proposition  3.1  (a)  E(n(s,t))  *  0 

(b)  Assume  s  <  s' , 

r((s,t),  (s'.t')) 

-  -8(s)  +  [H(  s,0)  E[Cs(Y,  62,t)5(X,  fi^s'MCX  >  s)] 

+  [H( s,0) ]  1{ / QH(y | s')[H(y| s)]  2gg-(y  t')dH1(y|s) 

-  /q  IH(y  i  s)  ]_1  gs.(y  t')dH^(y |  s')  -  /J  [H(y|s)  H(y  |  s')  y  |  s' 


Proof  of  (a): 

E(n(s,t))  -  E[£(X,  «lt  s)  +[H(s,0)]"1?g(Y,  62,t)I(X  >  s)] 

-  E(C(X,  6:,  s))  +  62,  t)]*P(X  >  s) 

*  0,  since  both  expectations  above  are  zero  by  (L&S](l985). 

Proof  of  (b) :  Due  to  the  conditional  argument  in  CgCY.^.t),  covariance 
structure  of  the  bivariate  case  is  much  more  complicated  than  the  univariate  case 
and  is  calculated  in  Appendix  II.  Q 

When  s  *  s',  the  covariance  structure  in  (b)  is  much  simpler,  and  we  have: 

Corollary  3.2.  (a)  r((s,t),  (s,t'))  -  -g(s)  -gg(tAt') 

(b)  Var(n(s,t))  -  ~(g(s)  +  gg( t ) ] . 

Proof:  It  can  be  checked  easily  from  the  proof  in  Appendix  II  that  the 
second  term  of  r((s,t),  (s',t'))  vanishes  when  s  *  s'.  The  rest  of  the  proof 
follows  immediately.  □ 


4.  Weak  Convergence* 


-  -1 

Let  n^s.t)  -  n(Xit  Y^  6^,  621,  s,t),  n(s,t)  -  n  E  n^s.t), 

_  _  *  _  *  *  _  * 

^(s.t)  -  FCs.On^s.t),  4(s,t)  -  F(s,t)n(s,t)  and  ^(s.t),  n  (s,t),  ^(s.t),  4  (s,t) 

be  their  bootstrap  counterparts.  We  shall  prove  the  tightness  of  the  processes 
1/2—  1/2— 

n  n(s,t) ,  n  c(s,t)  and  their  bootstrap  counterparts.  Weak  convergence  of  the 
corresponding  processes  to  Gaussian  Processes  then  follow  from  the  Cramer-Wold  device. 
For  any  block  E  »  (s,s']  x  (t,t']  define 

X(E)  -  n(s',0  -  n(s,t')  -  n(s',t)  +  n(s,t) 

Xi(E)  -  n1(s',t')  -  n^s.t')  -  n^s'.t)  +  n^s.t). 

X  (E)  -  n1/2In(s' ,t')  -  rf(s,t')  -  n(s',t)  +  n(s,t)]  -  n"1/2  E  X  (E) 
n  i-1 

Lemma  4.1.  There  exists  a  positive  finite  measure  W  on'l^+*^+  such  that 

E( | X(E) | 2 )  <  W(E) ,  for  any  block  E  in  JO ,S ]  *  [0,T). 

Proof:  The  proof  is  given  in  Appendix  HI.  0 

Let  B  ■  (s^jSj]  x  (t^.tj],  C  *  (£2*83]  x  < t ^ , 1 2 ]  by  any  two  neighboring 
blocks  in  [0,S]  *  [0,TJ. 

Lemma  4 .2 .  E( | ( B ) |2 |Xn(C) J2)  <  2W(B)W(C)  +  0(n  *),  where  0(n  *)  is  independent 
of  B  and  C. 

Proof:  E(|Xn(B)j2|Xn(C)|2) 

•  n'2E[(EX1(B))2  (EX^C))2] 

-  n"2E([E  X2  (B)  +  E  X  (B)X  (B)][E  X2(C)  +  E  X  (C)X  (C)]) 


n”2  (nECX2  (B)  X^C))  +  n(n-l)  E(X2  (B) )  ^(X2  (C)  )  + 


n(n-l) (E(X(B)X(C) ) ]2 } 

<  2E(X2(B))*E(X2(C>)  +  0(n-1),  where  0(n_1)  is  independent  of  B  and  C 
since  X(E)  is  uniformly  bounded  for  any  block  E, 

<  2W(B) *W(C)  +  0(n-1) .  □ 

We  shall  use  the  convergence  criteria  for  multiparameter  stochastic  processes 

by  Bickel  &  Wichura  (1971);  hereafter  abbreviated  as  [B&W]  (1971)  to  prove 
the  following  tightness  theorem. 

Theorem  4.1.  If  G(a, 0)  and  F(s,t)  are  both  continuous,  then  the  processes 
\/2 _  1/2  — *  _ 

(n  n(s,t)}  and  (n  [n  (s,t)  -  n(s,t)]}  are  both  tight  on  [0,S]  *  [0,T]. 

Proof:  From  Appendix  III,  W(x,y)  ■  constant  *H(x,0)Hj(0 ,y)  +  constant  •H1(x,y), 
where  H^(x,y)  »  P(X>s,  Y>t,  Sj*  1) •  The  measure  W  has  continuous  marginal  since 
F(s,t)  and  H(s,0)  are  both  continuous  under  our  assumptions.  We  shall  apply 
Theorem  3  of  [B&W] (1971). 

Replace  W(E)  by  W  (E),  where  W  (E)  -  21/2W(E)  +  0(n"1/2)  and  0(n'1/2)  is 
n  n 

independent  of  the  block  E  in  [0,S]  *  [0,T].  Hence  (Xn,  Wn)eC  (2,4),  where 
C  (8,v)  is  defined  on  page  1658  of  [B&W](197l). 

1/2— 

Theorem  3  and  the  discussion  after  it  then  implies  that  Xn(s,t)  »  n  n(s,t)is  tight 
Noted  that  although  Xn(s,t)  does  not  vanish  along  the  lower  boundary  of 
[0,S]  x  [ 0  ,T ]  ,  it  can  be  modified  by  subtracting  the  boundary  value  of 
Xn(s,t)  from  it. 
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1/2  _*  _ 

To  show  the  tightness  of  n  (n  (s,t)  -  n(s,t)),  recall  that  Theorem 
3.1(c)  implies  that  bootstrapping  Fn(s,t)  amounts  to  drawing  random  sample 
{^(s.t),  i  *  l,...,n}  from  the  population  which  assigns  equal  mass  (1/n) 
to  each  of  the  n  functions  (n^(s,t),  i  *  l,...,n).  For  any  block  E  let 

X  (E),  *n(E)  be  defined  as  in  X(E),  Xn(E)  by  replacing  n  by  n  -  n.  Following 

*  2  —1  1/2 

tne  proof  of  Lemma  4.1  one  can  show  that  E(|X  (E)|  )<  W(E)  +  0((n  log  n)  ) 
-1  1/2 

where  0((n  log  n)  )  is  independent  of  the  block  E.  Lemma  4.2  then  implies 

,  *  ,2  ,  *  .2  -1  1/2 

that  E(  X  (B)  X  (C)  f  )  <  2W(B)W(C)  +  0((n  ilog  n)A/  )  a.s.  The  rest  of  the 

1/2 — 

proof  is  similar  to  that  of  n  n(s,t).  □ 


The  following  corollary  is  immediate. 

Corollary  4.1.  Under  the  assumption  that  G(s,0)  and  F(s,t)  are  continuous 


the  process  (n  ?(s,t)}  and  (n  (s,t)  -  Z(s,t)}  are  both  tight  on  [0,S]  «  [0,T] . 

Theorem  4.1  and  its  Corollary  also  show  that  both  the  bivariate  hazard  process 
and  PL-process  converge  weakly  to  a  two  parameter  mean  zero  Gaussian  process  with 
covariance  r((s,t),  (s',t')>  and  F(s, t)F(s' . t ')T( ( s, t) , (s' , t ') )respect ively . 

1/2  A*  A  1/2  * 

To  show  that  n  (Fn  -  Fn)  converges  to  the  same  Gaussian  process  n  (F  -  F), 

1/2  — *  — 

we  only  have  to  show  that  the  finite  dimensional  distribution  n  [C  ~  t(s,t)] 

for  some  {(s^,t^),  l<i<k},  converge  to  the  k-variate  Guassian  distribution  with 
mean  zero  and  dispersion  matrix  {F(S^ ,t^)F(S j ,t j)T((S^ ,t ^) , (S j ,t j))} .  This  follows 
directly  from  the  bootstrap  central  limit  theorem  for  sample  means  (Bickel  and 


Freedman  (1981)  or  Singh  (1981)).  Thus  we  have  proved  the  following  corollary. 


Corolla 


Under  the  assumption  that  G(s,0)  and  F(s,t)  are  continuous 


*'  (Fn(s,t)  -  F(s,t))  and  nJ'' “ (Fn(s ,  t)  -  Fn(s,t))  both  converge  to  the  two- 
arameter  Gaussian  Drocess  with  mean  zero  and  covariance  F(s, t)F(s', t')T(( s, t) , ( s' , t ' ) ) 


We  have  thus  shown  that  the  bootstrap  method  works  under  the  bivariate  random 
censorship  model,  which  provides  a  way  to  estimate  the  standard  error  of  F^(s,t) 
or  to  construct  a  confidence  interval  (band)  for  F(s,t).  This  is  most  valuable 

A 

since  the  covariance  structure  of  Fn(s,t)  is  very  complicated  as  shown 
in  Proposition  3.1. 

5 .  Modified  estimators. 

A 

The  bivariate  PL-estimator  Fn(s,t)  defined  in  section  1  may  not  be  a  survival 
function.  Examples  are  given  in  [C&F]  (1982)  and  Campbell  (1981).  What  happen  is 

A 

that  although  Fn(s,t)  is  a  non-increasing  function  of  t  when  s  is  kept  fixed,  it 
may  not  be  nonincreasing  function  of  s  when  t  is  kept  fixed.  We  shall  modify 

A 

F  (s,t)  to  be  a  survival  function  and  this  modified  estimator  is  closer  to  the  true 
n 

A 

survival  function  F(s,t)  then  Fn(s,t)  in  Supnorm  distance. 

%  A 

For  any  0<s<°°,  0<t<°°,  define  F  (s,t)  *  Sup  F  (s',t).  Note  that  F  (s,t)  is  a  step 

s'>s 

w  A  A 

function  and  Fn(s,t)  -  F^s^)  “  Sup  for 


Proposition  5.1.  Fn(s,t)  is  a  survival  function. 

Proof:  For  s'^s,  it  is  clear  that  Fn(s,t)  >  Fn(s',t). 

A  A  A 

For  t'>t,  F  (s, t)  -  Sup  F  ( s' , t)  >  Sup  F  (s',t')  -  F  (s',t'). 
n  >  n  ^  n  n 

s  >s  s  >s 


For  each  s,  let  x  be  the  x,  such  that  F  (s,t)  *  F  (x,,t)  “  Sup  F  (x.  ,t) 


VMM1  »AJ-  '■  A  .■J.'.H'A  .'i'iLH.L..u.f,-.vv 
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Since  F  (s,t)  <  F  (s,t)  and  F(s,t)  >  F(x  ,t),  we  obtain  the  following: 
n  n  s 

F  (s, t)  -  F(s,t)  <  F  (s,t)  -  F(s, t)  <  F  (x  t)  -  F(x  t). 
n  n  n  s  s 

It  then  follows  immediately  that 

Proposition  5.2.  Sup  |F  (s,t)  -  F(s,t)|  <  Sup  |F  (s,t)  -  F(s.t)1 
0<s,tO  n  0<s,tO  n 

1/2 

Proposition  5.2  implies  that,  for  any  A  *  o(n  ), 

n 


An  Sup|Fn(s,t)  -  Fn(s,t)i  ♦  0  a . s . 
s,t 


(5.1) 


1/2 

It  is  not  clear  yet  whether  A  can  be  taken  at  the  rate  of  n  .We 

n 

1/2 

conjecture  that  (5.1)  hold  for  A^-  n  under  some  strict  uniform  monotonicity 

1/2  - 

of  F(s, t) ,  and  hence  n  (Fn(s,t)-F(s,t))  converges  weakly  to  the  same 

1/2  * 

Gaussian  process  as  n  (Fn(s,t)  -  F(s,t))  does. 


6 .  Generalizations  to  multivariate  survival  function. 

For  multivariate  survival  function  FCs^.Sj  , .  •  •  .s^)  *  we  can  define  the 
multivariate  PL-estimator  by  conditioning  argument  similar  to  that  of 

A  A 

F  (s,t).  See  Horvath  (1983)  page  203  for  such  extension.  Let  F  (s1,...,s.  ) 
n  n  i  k 

denote  the  multivariate  PL-estimator  so  defined.  All  the  results  in  this 
paper  can  be  generalized  to  Fn(s^, • • • fS^)  with  similar  arguments. 


7 .  Appendix  I;  Proof  of  Lemma  3.1. 

Define  the  following  empirical  survival  functions: 
-1  n 

H  (s,t)  *  n  I  I(X . >  s,  Y, >  t),  hence  m  ■  nH  (s,0), 
n  i.i  1  1  s  n 


Hn(t|s)  -  m”1  £  I(Xi>  s,  Yt>  t),  Hln(t|s)  -  m"1  I  ^I(Xi>  s,  Y±>  tf«2l-  1 

Let  Rnl(t|s)  «  log  Fn(t|s)  -  J^H^y i s) ]_1dHln(y | s) , 


Rn2(t!s)  "  /S{fHn(y|s)]"1-  [H(y I s) ]  ^dH^s)  - 

JJ[H(y|s)  -  Hn(y|s)][H(yjs)]~2  dH^yls), 

Rn3(t!s)  *  /q^  [  Hn(  y  1  s)]-1-  [H(y  |  s)  ]-1}  d(Hln(y|s)  -  H^yls)). 
[Part  1] 

Proof  of  Lemma  3.1(a): 

H1(t|s)  -  P(Y  >  t,  62*  1 1 X  >  s) 

*  P(Y°>  t,  Y°  <  D 1  X°  >  s ,  C  >  s) 

=  -  /  G(y | s)dF(y | s) ,  where  G(t|s)  *  P(D>  t|  C  >  s). 

Hence  dH^(t|s)  =  G( t j s) • dF( 1 1 s)  . 

As  a  result  log  F(t|s)  ■  /^[FCyls)]  ^dF(y|s) 

*  Iq  [H(y | s) ]  1dH1(y|s). 


It  can  be  checked  easily  as  in  the  proof  of  Theorem  1  of  [L&S]  (1985)  that 


n'LZ  n(XA  ,  Yt,  611,  621,  s,  t)  -  /q  [H(  y  |  s)  ]  2[H(yjs)  -  HR(y  |  s)  ]  dH^  y  |  s) 

+  /J[H(y!s)]"1d(Hln(y|s)  -  H1(y  j  s) ) . 

Hence  log  F^tjs)  -  log  F(t|s)  -  Rnl(t|s)  +  n  1  En^,  Y^  6^,6^,  s,t^ 

+  Rn2(t|s)  +  Rn3(t|s). 

From  (8)  of  [L&S]  (1985),  for  any  0<s<S,  Sup  |R  - ( C | s ) |  -  0(m  1).  a.s. 

0<t<T  ni 

Since  ms>  m^  for  any  0<s<S,  and  0(n)  a.s.,  we  have 

Sup  |R  (t|s)|  =  0(n  H  a.s. 

0<s<S,  CKt<T  n 

Next,  consider  Rn£ ( t | s ) . 

lRn2(tls)l  “  |/otH<y I s>  ~  Hn(y|s)]2tHn(y|s)H2(y|s))'1dH1(y|s)| 

<  Sup  | H( y | s)  -  H  ( y | s ) j 2  •  inf  [H  (y|s)*H2(y|s)]  (7.1) 

0<y<T  0<y<T 

By  triangular  inequality, 

Sup  | H ( y | s )  -  H  (y | s) |  <  Sup  [H(s,0) ]_1[ |H(s,y)  -  H  (s,y)|  +  |H  (s,0)  -  H(s,0)|] 
0<s<S,  0<s<S , 

0<y<T  0<y<T 

-1  1/2 

-  0((n  log  log  n)  )  a.s.,  from  the 
law  of  iterated  logarithm  for  empirical  distribution  functions 
(See  Kiefer  (1961)). 

Since  both  H(y|s)  and  H  (y|s)  are  bounded  away  from  zero  (a.s.)  (7.1) 

implies  that  Sup  |Rn2(tjs)|  *  0(n  Hog  log  n)  a.s. 

0<  s<S  CKt<T  n 


It  only  remains  to  prove 


Sup  |R  3<t| s) |  =  0( (n_1 log  n)3/4)  a.s.,  (7.2) 

0<s<S,  0<t<T  n 

and  this  can  be  done  by  similar  argument  of  Lemma  2  of  [L&S](1985).  We  shall 
provide  the  proof  when  G  is  also  assumed  to  be  continuous  (and  hence  H  is  continuous) 
The  argument  can  be  extended  to  the  case  when  G  is  arbitrary  as  the 
remark  after  Lemma  2  of  [L&S](1985). 

1  /2 

Let  k  *  O((n/log  n)  ),  y  =  0,  y  =  T.  Partition  the  interval  [0,T]  into 
n  jl  k  .  « 

n+1 

-1  1/2 

subintervals  [y^,  Yi+1l  i  =  l,...,kn,  such  that  HtO.y^)  -  H(0,yi+^)  =  0((n  log  n) 

—1  1  /  2 

and  hence  both  H(s,yi)  -  H(s,yi+^)  and  H(yj|s)  -  H(yi+1)s)  are  0((n  log  n)  ) 
uniformly  in  s.  From  now  on,  all  the  0(*)  terms  hold  uniformly  for  0<s<S,  0<t<T. 
|Rn3(t|s)i 

^n  y 

<  Z  |/y^+1v[Hn(y|  s))”1-  [H(y  |  s)  ]~1-  [H^  |  s)  ]_1+  [H^  |  s)  l"1 1  }d(Hln(y  |  s)  -  H^yjs)) 

k 

^  y  14.1  _  1  _i 

+  Z  J/y  C[Hn(y1|s)]  -  [H(yi|s)]  }  d(Hln(y|s)  -  H1( y | s) ) | , 

<  2  max  Sup  |[H  (yjs)]  1  -  [H(y | s) ]  1  -  [H  (y  | s) ]  1  +  [H(y  |s)]  X| 

°<i<kn  yt<y<yi+1 

+  R  Sup  | [H  (t|s)]-1-  [H( t  j  s) ]  1 |Sup  lHin(yi+i|s)-  Hi<y1+1 ls>“Hn  (Yj | s)+H.(y  |s) ! 
0<t<T  l<i<k  1  n  x  1  x 


<  A  +  B  (say) 


To  evaluate  A,  partition  [y1,  yJ+1]  into  subintervals  [y^,  yi^+1^], 
j  *  l,...,an,  where  an=  0((n/log  n)1/4),  Vn  -  y^  y±  (  y  such  that 

“  H(0.yi(j+1))  =  °((n  n)3//4),  and  hence  both  HCs.y^)  -  HCs.y^^) 

and  HCy^Js)  -  H(y1(j+1)|s)  are  0((n_1  log  n)3/4). 


Consider 


Sup  | [H  (y | s) ]  [H(yls)]"1  -  [H  (y  Is)]'1  +  [H(y . (s) ]_1 | 

Vy<yi+1 

<  max^  |[Hn(yljls)]'1-  [H^yjs))"1  -  [HCy^s)]'1  +  [HCyJs)]'1! 

1<j<3n  J 

—  1  3/4 

+  0((n  log  n)  ) ,  by  monotonicity  of  H  (y|s). 

n 


"  “ax  UHn(yijls)  '  HCyij|s)HH(yi  |s)]~2  -  [H  (y  |s)  -  H(y  |  s)  ]  [  H(y  |  s)  ]  “2  | 
n 

+  0((n  log  log  n)  +  0((n  1  log  n)3^4)  a.s.,  by  LIL  for  empirical  distribution 
function  and  strong  law  of  large  number. 

<  [H(S.T) I [Hn(yiJ Is)  -  H(yij|s)]H2(s>yi)  -  [Hn(yi |s>  -  H(y± | s ) ] H2 ( s , y ± j ) | 


<  max  [H(S,T)]“4| [H  (y  |s)  -  H(y 
1< j<a  n 


-1  3/4 

+  0((n  log  n)  )  a.s, 


‘  “*<a  IH<S'T>r  -  «yUls)  -  H„(yi|.)  +  H(yi|,)|  +  2|HC«,yi>  -  H(s,yu)| 


•|Hn(y1ls)  -  H< yj I s) I )  +  0((n~hog  n)3/4)  a.s. 


*  max  [H(S,T)f4{|Hn<s,yij)  -  H^s.y^  -  H(s,yij)  +  HU.y^  ]  /H(s,0)}  +  O(n_1log  n) 

1< j<an 

-1  3/4 

+  0((n  log  n)  )  a.s.,  by  LIL  for  empirical  distribution  function.  Use  the 
exponential  inequality  of  Lemma  1  in  [L&S](1985)  to  get  the  following  probability 


bound  as  in  Lemma  2  of  (L&S](1985): 


max  max  P(  |H  (s,y  )  -  H  (s,y  )  -  H(s,y,  .)+  H(s,y  ))|  >  constant  *n  "^log  n^4) 
a. n  lj  n  l  xj  i 


0<i<k  l<j<a 
n  J  n 


=  0(n  J).  It  then  follows  from  Bonferroni  inequality  and  the  Borel  Cantelli 
Lemma  that  A  *  0  ((n  Hog  n)^4)  a.s. 

To  estimate  B,  notice  that  |H^(s,yi+j)  -  H^Cs.yj)!  <  |H(s,y1+1)  -  H(s,yj)|. 

The  rest  of  the  proof  is  similar  to  that  of  A  and  in  fact  easier,  since  one  need 
not  to  partition  the  interval  [y^,  y^+^]  further  as  in  B.  We  thus  have 
B  *  0((n  Hog  n)^4)  a.s.  . 

(7.2)  now  follows  immediately.  £] 

(Part  2] 

Proof  of  Lemma  3.1(b): 

Define  H^s.t),  Hn(tjs),  and  H^n(t|s)  as  Hn(s,t),  Hn(t|s),  H^(t|s)  by 

using  the  bootstrap  sample  instead.  For  example, 

*  *  ^  *  *  * 

Hin(t|s)  *  [mg]  Z  I(Xi  >  s,  >  t,  <521“  ^  *  BY  the  same  argument  as  the  proof  of 
Lemma  3.1(a)  above  and  Theorem  1  in  [L&S]  (1985),  we  have  the  following  bootstrap 


version  Sup  |log  F*  (t|s)  -  /n(H*(y|s)]  1dH*  (y|s)|  -  0(n  H  a.s.  (p*). 


0<s<S,  0<t<T 


Since  Sup 


0<  s<S ,  0<t<T 


| R  i ( s , t ) |  ■  0(n  1)  a.s.,  we  arrive  at  the  following: 


»-"!?’->  »J!  •  S  »V  '  JMT*  r**XTX-JV i*n*j2<. rm: 
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log  F*( t  J  s)  -  log  Fn(t|s)  «  / q ( [H*( y | s) J  1  -  [«n(y | s) ]  1}dHln(y|s) 

+  /olHn(y|s)]“1d(H*n(yj s)  -  Hln(yjs))  +  0(n-1)  a.s.  (p*) 

*  I  +  II  +  0(n  3 )  a.s-  (p  ),  where  0(n  ^)  holds  uniformly  on  [0,S]*[0,T]. 

Mimicing  the  proof  of  (a)  for  R^Ctls),  we  have 

I  -  /o{ [Hn(y I s) ]_1  ~  [Hn(y|s)]_1}dHln(y|s)  +  0((n~1log  n)3/A)  a.s.  (p*) 

*  JTq lHn< y I  s)  -  H*(yj  s) ]  [Hn(y|s)]~2dHln(y|s)  +  0(n-1  log  n) 

+  0((n-1  log  n)3y,A)  a.s.  (p  ) 

-  /J[Hn(y|s)  -  H*(y|s)][H(y!s)]_2dHln(y|s)  +  OUn'hog  n)3/4)  a.s.  (p*)  (7.3) 

The  last  two  equalities  follow  by  similar  argument  as  Rn2(t|s)  in  Lemma  3.1(a). 
Mimicing  the  proof  of  Lemma  3.1(a)  for  Rn3(t|s)  once  more,  we  have 

II  -  /J[H(y|s)]'1d(H*n(yls)  -  Hln(y|s))  +  0((n'1log  n)3/A)  a.s.  (p*)  (7.4) 


Lemma  3.1.(b)  now  follows  from  (7.3)  and  (7.4)  since  all  the  0(*)  terms 
hold  uniformly  on  [0,S]*(0,T].  Q 


8.  Apoendix  II:  Proof  of  Proposition  3.1(b) 


Cov(n(s,t),  n(s',t')) 

■  E(n(s,t)n(s'  ,t')) ,  from  proposition  3.1(a) 

-  E{[;(X,61,s)  +  lH(stO)flCs<Y,  62,t)I(X  >  s)  ]  •  U(X,  ,s')  + 

[H(s',0)f1Cs.(Y,  62,t')I(X  >  s')]} 

-  EtC(X,61,s)*C(X,61,s')]  +  [H(s,0)]“1E[5s(Y,62,t)I(X  >  s)*C(X,61,s')] 

+  [H(s',0)f1E[C(X,  61,s);s.(Y,  62,t')I(X  >  s')]  +  [H(s,0)H(s' ,0) ]_1 

*  E[Cs(Y,62,t)-Cs>(Y,«2,t')I(X  >  s'  V  s)] 

-  I  +  II  +  III  +  IV,  where  s'  s  -  max{s',  s} . 

It  follows  from  direct  calculation  or  [L&S]  (1985)  that  I  *  -g(sAs')  *-g(s), 
for  s  <  s'. 

Next  we  shall  show  that  III  vanishes  for  s  <  s'. 

To  see  this,  consider 

E[?(X,61,s)-Cs.(Y,62,t')I(X  >  s')] 

-  E{  [g(XA  s)  +  [H(X,0)]'1I(X  <  s,  6X-  D]  tgg-(Y/\  t')  +  [H(y  |  s')  ]“1I(y  <  t',«2- 
•I(X  >  s')} 


-  {EYlx>s.[g(s)gg.(YAt')]  +  EY  ^|x>g.[g(s)[H(Y|s')]"1I(Y<t',  Sf  l)]}«H(s',0) 

-  {/J  H(y|s')dgs.(y)  -  /J'  ]H(y|s')]-1dH1(yis')}g(s)H(s',0) 

-  0,  since  dg  „(y)  -  [H(y |s')]-2dH.(y| s'). 


Hence  III  ■  0,  for  s  <  s' . 

Since  II  can  not  be  simplled,  we  shall  leave  it  as  it  is.  Noted  that  if 
s>s',  by  symmetric  argument,  II  ■  0. 

It  remains  to  evaluate  IV. 

IV  -  (H(s,0)H(s',0)]  "1E[Cs(Y,62,t)?s.(Y,62,t')I(X  >  s'V/s)] 

-  [H(s,0)H(s',0)]_1H(s',0)EY|x>s.{[gs(YAt)  +  [H(y | s) ]_1I(Y<t,  ^-l)]* 

lgsAUt')  +  [H(Y|  s')]”*I(Y<t' ,  62-  1)]} 

-  H(s,0)]‘1{EY|X>s.[gs(Y/lt)gs.(YAt-)]  +  EY|X>s.[gs(YAt)[H(Y|s')]‘1I(Y<t',62-l)] 

+  EY|X>s-l8s-CYAt'){H(Y|s)r1I(Y<t,  <S2«  1)]  +  Ey | x>s* ( [H(Y | s)H(Y | s') f XI( Y<tAt' , 62»1) ] 

-  [H(s,0)]“1[IVa  +  IV b  +  IV c  +  rvd ] . 

By  integration  by  parts, 

IVa  *  /oH(y  I  s')  8s-(yA  t')[H(y|s)]'2dH1(y|s)  +  /J  H(y  |  s') *gs(Y  A  t)  [H(y  |  s')  f^H^y  |  s' ) , 

-  IV  .  +  IV  ,  . 
al  a2 

It  is  easy  to  show  that, 

IVb  “  "  Jo  8s(YAt)[H(y|s')]~1dH1(Y|s')  -  -  IVa2, 

IVc  -  -  /^8s-aAt')(H(y|s)]"1dH1(y|s'), 

Ivd  *  ~  C  t H< y }  s)H(y|  s')]  1  dH^yJs'). 

Hence  IV  -  [H(s,0)]-1[IVal  +  ivc  +  IVd],  for  s  <  s'. 

□ 


The  proof  is  now  completed. 


9.  Appendix  III:  Proof  of  Lemma  4.1. 


Since  n(s, c)  is  uniformly  bounded  random  variables  for  (s,t)  In  [0,S)*[0,T], 
let  M  be  chis  uniform  upper  bound. 

Let  e  -  H(S,T)  >  0. 

E((X(E)]2)  <  4M  E|X(E) j 

-  4M  E|n(s,t)  -  n(s,t')  -  n(8',t)  +  n(s',t')| 

-  4M  E|[H(s,0)]_1I(X>s)Ufi(Y,62,t)  -  Cg(Y,  62,t')]-  [H(s'  ,0)  ]*1I(X>s'  )• 
[Cs.(Y,  62,t)  -  5s-(Y,62,t')]| 

<  4M  E|[H(s,0)j'1I(X>s)[g8(YAt)  -  gs(YAt')]  -  [H(6',0)]'1I(X>s')[gs.(YA  t) 

-  gs.(Y/\  t')]|  +  4H  E|[H(s,0)]"1I(X>s)I(t<Y<t',62-  DIHCYls)]*1 

-  [H(s',0)]‘1I(X>s")l(t<Y<t%62«  l)-[H(Y|s')]_1| 

■  4M  (I  +  II),  where  I,  II  stands  for  the  first  &  second  expectation 
respectively.  (9.1) 

Let  H^(s,t)  »  H^( t | s) *H(s,0)  ■  P(X  >  s,  Y  >  t,  52»  1).  Let's  consider  1  first. 

I  -  E|l(x>s)-J**^  [H(s,y)  ]~2dH1(  s,y)  -  I(X>s')  ^lH(s',y)  J^dH^s'  ,y)  | 

<  E|J™J,  (H(s,y)j'2dH1(s,y)  -  J™  (H(s'  ,y>  J^dH^s'  ,y)  | 

+  E| I( s<X<s' )i y/\  t'  lH(3,y)j"2dH1(s,y)| 

<EI/^  J'([H(s.y)]'2-lH(8',y)]"2)dHi(8,y)|  +  E|/**‘.  (H(s',y)]~2d(H1(s,y)  -  H^s'.y)) 


y.y 


+  e|i(s<x<s')  /y^'  (H(8.y))’2dHi(8»y>l 

-  la  +  !b  +  Xc- 

ia  <  2e-4  ei;^ a  t'  fH(s*y)  ■  H<s'*y^  dHi(s.y)l 

<  2  e"4  [H(  s,0)  -  H(s',0)]'E|H1(s,Y  At)  -  H^s,  YAt')| 

<  2e"4  [H( s, 0)  -  H(s",0)]*E[H1(0,YA  t)  -  H^O,  YAt')| 

<  2 e'4  [H(s,0)  -  H(s"  ,0)  ]  (H^O.t)  -  H^O.t')] 

Ib  <  e_2E]H1(s,YA  t)  -  H^s'.YAt)  -  H-^s.YAt')  +  H^s',  YAt')| 

<  e'2[H1(s,t)  -  H^s'.t)  -  H^s.t')  + 

Ic  <  e~2E|I(s<X<s')*  [H1(s,Y A  t)  -  H1(s,YAt')]| 

<  e~2E|l(s<X<s')*  (H^O.YAt)  -  H^(0,Y  A  t')]  | 

<  e*2[H(s,0)  -  H(s',0)][H1(0,t)  -  H^O.t')] 

Next,  consider  II 

II  -  E|l(t<Y<t',  62«  l)[I(X>s)(H(s,Y)]_1“  I(X>s')(H(s',Y)]"1] | 


(9.2) 


(9.3) 


(9.4) 


(9.5) 


<  e"2E|I(t<Y<t',  1) • [H( s' ,Y)  -  H(s,Y))|  +  e-2E| I( t<Y<t' ,  «2"  l)I(s<X<s')| 
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<  e'2[H(s,0)  -  H(s',0)]«H1(0,t)  -  Hj^O.O]  +  e'^H^s.t)  -  H^s.t')  -  H^s 


(9 


For  any  x,  y 

let  W(x,y)  =■  W((x,“)x(y,*)) 

-  AM  [2e~V  2e“2]H(x,0)H1(0,y)  +  8Me'2H1(x,y) . 

It  now  follows  from  (9.1)  to  (9.6)  that, 

E( [X ( E ) ] 2 )  <  W(E) .  □ 


Noted  that  we  have  used  the  same  notation  W  for  both  the  measure  and  the  survival 
function. 
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